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ABSTRACT 


Colorectal cancer, which is frequent, recognized tumours in both genders around the globe. As per the report generated by WHO 
in 2018, colon cancer placed in the third position, whereas 1.80 million individuals are affected. Precisely, it is the succeeding 
leading cancer, which is the second most common cause of cancer in females, and the third for males. The loss of control over 
the integrity of epidermal cells in bowel or malignancy can be the cause of colorectal cancer. An effective way to recognize colon 
cancer at an early stage and substantial treatment can reduce the ensuing death rates to a great extent. To perform Screening 
of Morphology of Malignant Tumor Cells in the colon, a Gastroenterologist may refer to cancer diagnosis tests for pathological 
images. In any Histology method, the process takes a significant duration of time due to infinite numbers of glands in the gas- 
trointestinal system, which may lead to irreconcilable outcomes. By diagnosing through computer algorithms, can give practical 
and contributory results. Hence, accurate gland segmentation is one crucial prerequisite stage to get reliable and informative 
morphological image data. In recent times, the scholars applied deep learning algorithms to pathological image analysis for the 
diagnosis of cancer disease. We propose that features extracted from the diagnostic tests, given as input to a deep learning 
architecture used along with semantic segmentation algorithm, provide results that are accurate than the existing image seg- 
mentation algorithms. This work is the extensive review of deep learning architectures used for semantic segmentation on the 
histological images of the colon. 
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INTRODUCTION num to the anus. It absorbs the fluids and electrolytes, and 

compels the solid waste to the rectum along with anus for 

The occurrence and fatality percentage of colorectal malig-  purgation. The abnormal development of cells on the inward 
nancy has much increased in contemporary years. More of- Jining (mucosa) of the proximal colon or maybe distal colon, 


ten, Pathologist’s diagnosis depends on pathology reports of known as polyps, may be malignant or benign. 
images and from biopsies, provides information about the 


escalation of cancer through the lymph and other organs of 
the body. This procedure not only takes a great deal of time 
and also price. However, it likewise has apparent constraints. 
The research study shows that the analysis of various pa- 
thologists has even more significant incongruity.' The pri- 
mary factor for this incongruity is that the pathology medical 
diagnosis technique is subjective as well as easily affected 
by the atmosphere. Diagnosis of photos utilizing computer- 
based algorithms can be an efficient method for sustaining 
the medical diagnosis.” 


Many millions of organs in large intestine and rectum, 
take care of the absorbing of water as well as minerals 
and also secreting mucous for the regrowth of epithelial 
cells.’ Nevertheless, an age far more than 50, a family his- 
tory of colorectal cancers, Personal history of uterine, breast 
cancer, or maybe ovarian cancer can improve the possibility 
to affect by colorectal cancer. In sporadic cases exposure to 
carcinogen agents in the environment, specific genetic rea- 
sons may be the reasons. The stage of disease describes just 
how much it has spread, the grading stage of cancer helps to 


a . . choose the best treatment.° Figure 2 demonstrates the stages 
As shown in Figure 1, the bowel is the collection of hollow with a number from zero to four. 


organs took part in a long, twisting tube starting from duode- 
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Figure 1: Anatomy of the large intestine’. 


The stages of 
colon cancer 
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Spread to other organs 






Figure 2: Stages of the colon or rectal cancer’. 


We can speculate the Colon Cancer by the symptoms like 
changes in feculence and its habits. A sensation of non-emp- 
tiness right after a feculence, blood traces in egesta which 
darkens the stool, bright-coloured red blood observed from 
the rectum, bloating, and some sort of discomfort in the ab- 
domen. The heaviness in the stomach, which in turn results 
in refusing to eat for some time, unexplained weight loss. 
Unexplained iron deficiency in males, or maybe females af- 
ter menopause. Perhaps nearly all of these signs might addi- 
tionally signify other possible causes. It is advisable to con- 
sult a physician if these symptoms arise for more than four 
weeks. Stages in Colon Cancer are of four different stages,’ 
and even further classification observed. Nevertheless, the 
main aim of colorectal cancer screening is to recognize ir- 
regular growths (polyps), before they developed into malig- 
nant. The medical society recommends a medical screening 
should connect different criteria and reduces the number of 
deaths. 


Regular screenings 
Individuals that had colorectal cancer before, who are more 
than fifty years of age, are observed with inheritance with a 


particular type of cancer, or perhaps with inflammatory sort 
of disease of the intestines, ought to take regular screenings. 


Risk Factors 
Factors which takes a person to a higher risk for developing 
colorectal cancer include various factors like? 


Older age: Age plays a specific aspect in the predisposition 
to colon cancer. The statistics show that the age group near 
fifty is more prone to diagnosed. Sporadically could happen 
in young people. The average age of people who develop the 
disease is sixty-two years. 
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Age at Diagnosis 
Figure 3: Age-specific incidence of colorectal cancer in fe- 
males and males”®. 


Figure 3 represents the intensity of colon cancer depend 
upon the ages, which particularly highlights that the older 
age people are affected with colon cancer. 


African-American race: Greater possibility is found in Af- 
rican-Americans to get diagnosed with bowel cancer than the 
people of various other people of the world. 


Malignant growth(Polyps): If malignant polyp resected in 
previous times, consequently there is a risk of colon cancer 


Inflammation in entrails: Ulcerative colitis, chronic in- 
flammatory disease, and causes of inflammatory disease of 
the intestines are creating many ways to chance of colon 
cancer. 


Hierarchical Cause: The advancement of colon cancer es- 
calated to a person when parents, siblings, or maybe kid in- 
fected with the same disease. If the diagnosis reports positive 
for more numbers, then the risk is very high. 


High-fat, low-fibre diet: Low fibre diet and high in calories 
and fat (non-vegetarian with high in meats. 


Indiscipline lifestyle: Inactive, dormant lifestyle is much 
more prone to colon cancer. Physical exercise is an excellent 
way to prevent and even may reduce colorectal cancer. 


Pancreatic Diabetes: Diabetic issues and insulin consump- 
tion may have an increase in the risk of bowel or rectal cancer. 
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Obese individuals: Obesity causes an escalated peril of 
colorectal cancer and also increases the death rate with 
bowel cancer when compared to individuals who are with a 
healthy weight. 


Smoking: Smokers are more prone to occur with colorectal 
cancer. 





Alcohol: Frequent consumption of alcoholic beverages en- 
hances the risk of Colon Cancer. 


Radiology Medicine: Radiotherapy, which utilizes high 
doses of radiation to kill previous malignant cells and shrink 
tumours at the abdomen, raises the chance of rectal and co- 
lon cancer. 


DIAGNOSIS 


Screening can identify polyps before they start to be malig- 
nant, detection of cancer in the colon at the initial phases in- 
creases the chances of cure. The following are the preferable 
diagnostic procedures as well as screening methods for the 
detection of colorectal cancer." 





Test for occult blood in faeces 

Sample of faeces collected from the patient. Furthermore, to 
test for occult blood to suspect colorectal cancer, but which 
takes a long process. 


A DNA test on faeces 

To test the presence of pre-cancerous polyps, discarded in 
the faeces, DNA mutations are examined and analyzed. Un- 
like an occult blood test, this gives results accurately, which 
distinguishes from cancer from polyps but fails to indicate a 
particular tumour is present. 





Flexible Sigmoidoscopy 

Screening is done through a sigmoidoscope, which is a thin 
tube with a light attached in the end to provide light inside 
the colon and rectum to observe a patient’s colon. If some 
polyps recognized, then they are removed through colonos- 
copy after microscopic examination. 


X-ray with Barium enema 

The patient’s trails are induced some amount of barium in the 
form of an enema, and X-ray is performed, which produces 
double contrast. Barium dye, used in the trails sticks to the 
inner lining of the bowel, producing more precise images of 
X-ray. Small polyps missed by the barium enema X-ray, rec- 
ognized by flexible Sigmoidoscopy. 


Colonoscopy 
As represented in Figure 4, a colonoscope is similar to a sig- 
moidoscope rather have more length, and it is a slim tube 





with an electronic camera affixed at one end, to capture an 
inward view of the colon, and then displayed. During the 
test, if any polyp seems to be abnormal, biopsies, or tissue 
samples are taken. A colonoscopy is painless, but sometimes 
mild sedative is given to some patients not to feel pain while 
performing the colonoscopy. Before the colonoscopy, laxa- 
tive fluid is given to the patients to clean the colon. 


COLONOSCOPY 








d - _Colon polyp 


Light 





Colonoscope Instrument port 


Figure 4: Colonoscopy. "2 


CT Colonography 

Although colonoscopy is the best way for diagnosis of pol- 
yps and other abnormalities, in which some risks already 
analyzed. Perforation of inward tissues may result in bleed- 
ing and other complications. Hence, CT Colonoscopy is in- 
troduced. The patient put into the C.T. scanner and required 
observations made out using ultra-violet radiation passing 
through the body. 


Scan and Imaging techniques 

Ultrasound (Magnetic Resonance Imagining) scans can 
show the diffusion of cancer in the body. The waves can be 
penetrated inside the body and do not harm the internal tis- 
sues. Even though we may not get the best results, but some 
can deduce. 


TREATMENT FOR COLON CANCER 

The best treatment for colon cancer is finding and removal 
of polyps at an early stage by applying the screening. If the 
polyps are not cancerous, that means it does not consist of 
any nerves so that the patient will not feel pain during the 
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removal process. If a polyp leads to cancer, it needs surgery 
or chemotherapy to kill the malignant tumour cells. 


LITERATURE REVIEW 

Recently in this field of computer vision, deep learning 
techniques, Deep Convolutional Neural Network (DCNNs) 
thoroughly used in object detection in images.’*:'* As shown 
in Figure 5, various objects can be detected very accurately 
using deep learning architectures compared with traditional 
feature-based object detection algorithms. 





Object 
detection 


[-————— 


Dedicated object Generic object 
detection detection 


SSS 


Face Text Pedestrian Logo Video Vehicle Medical Image 

detection detection detection detection detection detection detection 
Figure 5: Dedicated and generic Object detection tech- 
niques." 


By the survey conducted by Saima Rathore et al., discussed 
several classification strategies, depending upon the spatial 
evaluation of colorectal biopsy images, and where they pro- 
vide an in-depth summary of techniques in each classifica- 
tion. Where each classification includes spectral, gene, tex- 
ture, serum, and O.O. Texture types of analysis.” Figure 6 
describes the step by step procedure to detect colorectal. 
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Figure 6: Classification of Colon Cancer Detection’®. 
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A unique DCAN given by Chen et al. deals with a multi- 
task learning framework,'*yields accurate polyp detection, 
and segmentation in the colon. Multi-level contextual fea- 
tures are discovered depend upon an FCN, which can iden- 
tify the contours of polyps in colon histopathological images 
very accurately. Aparna R et al. defined a novel algorithm to 
detect the polyps from colonoscopy images, by performing 
linear thresholding and Markovian Random Field to identify 
the saturated regions, segment the image depth-wise.'’ Then 
they used an SVM classifier to predict the condition of the 
disease by the help of colon correlogram vector and texture 
vector. 





Among the various neural network models, CNN based 
semantic segmentation models,'* FCN, is quite successful 
because of its accuracy results. One of the best models is 
VGG-16, which includes various techniques like bipolar in- 
terpolation used for upsampling the feature maps, to transfer 
the spatial level information, multiple skip connections are 
established. The conversion process of FCL to CNN is de- 
scribed in Figure 7. 


“tabby cat” 
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Figure 7: Converting-FCL of-CNN-to-convolutional-layers-20"® 


Chen LC et al. proposed a fully connected CRF attached to 
the final segment of DCNN,'? which can overcome the poor 
localization property of deep networks. H.Noh et al. pro- 
posed a model named Deconvnet,”’ in which semantic seg- 
mentation performed by learning from a deconvolution net- 
work, in which the topmost layers(convolutional) considered 
from the VGG 16-layer network. The deconvolution network 
is composed of deconvolution as well as un pooling layers, 
used to perform semantic segmentation. 


In the year 2012, AlexNet, a deep learning architecture pro- 
posed and which is one of the best architecture.*' AlexNet is 
the champion of the ILSVRC.”! The AlexNet, which contains 
a sequence of five convolution layers, and three fully con- 
nected dense layers associated with a softmax classifier used 
for image classification. In the year 2018, M Akbari et al. 
introduced a segmentation technique of polyps using CNN, 
in which a novel picture patch option technique performed 
in the training phase of the network. Moreover, in the pe- 
riod of testing, reliable post-processing on the chance map is 
done, which produced by the network.” U-Net has a dimin- 
ishing pathway as well as an expanding pathway. During the 
shrinking pathway, the function data is raised, while spatial 
information lowered. The expansive path 1s a combination of 
the features and spatial information, which gives more ac- 
curate segmentation. 





In the year 2017, Juan Jose Granados-Romero et al. pro- 
posed a review work on CCR, where they reported the fac- 
tors increasing the CCR in humans and listed various types 
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of tests to detect the malignant polyps.” In the year 2018, 
Ponzio et al. proposed an experimental research study on the 
classification of Colon Cancer, making use of Deep Convo- 
lutional Networks.” In this context, they work on an entirely 
new data set, which given for training to CNN models and 
then inspects the usage of transfer learning approaches. 


Akshay et al. Proposed Automated polyp detection deep 
learning algorithm(CNN), from CT Colonography images 
for Colon Cancer Diagnosis.” In the year 2018, Urban et al. 
published a write-up about localization and identification of 
polyps with 96% precision. They consider the colonoscopy 
for the screening of the colon, and then the images are fed to 
a Deep network.” Lorena Guachi et al. discussed the concept 
of deep learning and hierarchical learning methods to seg- 
ment the polyps in the colon with a Convolutional Neural 
Network.” 


SIGNIFICANCE OF THE STUDY 

The prime objective of my research is to develop an efficient 
Colorectal Cancer Detection Using Deep learning by Gland 
Semantic Segmentation from Morphology Images, which 
can detect the early stage Colon cancer. 


SCOPE OF STUDY 

To identify colon cancer following diagnosis are to be taken, 
CTC(Computed tomography colonography, Colonoscopy, 
Double-contrast BE, Sigmoidoscopy. In every test, the in- 
ternal portions of the rectum visualized to the Rectal Sur- 
geon, who can diagnosis the stage of rectal cancer. Image 
segmentation is a bit sophisticated task to map each pixel 
to its rightful class. It is applied to the MRI images to found 
the boundaries of glands and tissues in the colon to see the 
abnormal growth in the colon. Deep learning techniques, 
especially Convolution Neural Networks, are efficient for 
working with image analysis problems to get more accurate 
results. 


EXISTING METHODOLOGY 


Using CNN 

Convolutional Neural Network used in image analysis in 
particular fields of medical and bio-informatics, for pattern 
recognition of glands or tissues. CNN architecture organ- 
ized as a sequence of steps comprising of iterating pooling 
and convolutional layers, which are fully connected. 


The input information given through some defined size lin- 
ear convolution filters moved among the pooling layers. To 
reduce the number of attributes, a non-linear down-sampling 
is used to reduce the spatial input size. Then ReLU is used 
in Deep Learning extensively, considered to be efficient than 
other functions because of the reasons it is not continuous 
and differentiable, and the problem of vanish for high activa- 
tions not observed. Class label probability computed in the 


classifier layer, where the input information classified to a 
particular class based on the probability. And the last seg- 
ment in the system generates the output image. 





Using Fully Convolutional Network 

The first FCN takes in-mapping from pixels to pixels, with- 
out disengaging the district proposition.!8 The limitation of 
CNNs to acknowledge and deliver marks just for explicitly 
estimated inputs originates from the completely associated 
fixed layers. As opposed to them, FCNs just have convolu- 
tional and pooling layers that enable them to make forecasts 
oneself-assertive estimated inputs. 


Using U-Net 

The system demonstrated as the contracting way, and a broad 
path,” The convolutional organize structures the contracting 
way. Each evolution in a Broadway contains an up-sampling 
of the element map followed by a 2x2 convolution layer that 
parts the number of highlight channels, a link with the cor- 
respondingly edited element map from the contracting way, 
and two 3x3 convolutions, each followed by a ReLU. 





Using SegNet 

SegNet is encoder-decoder network adhered by multi-class 
pixel-wise classification(softmax) layer.’ The encoder net- 
work comprises of thirteen convolutional encoders, which 
are modeled particularly aimed to pattern recognition. The 
corresponding decoder layers are also 13 in number. In pre- 
vious SegNet architecture, learning takes place in the down- 
sampling phase only. In the up-sampling phase, instead of the 
learning process, it uses a bilinear interpolation of weights. 
So, SegNet architecture cannot segment the contour infor- 
mation of the glands or polyps from the test images, taken 
from colonoscopy tests. So, we introduce a new architecture, 
which can segment the edges and boundaries of the polyps 
accurately. 


Evaluation: The evaluation of images with ground truth im- 
ages is done by various metrics, in particular, dice index and 
Hausdorff distance. Segmentation accurateness calculated by 
the dice index by using Eq(1),*! which used to measure the 
similarity between GT object (G) pixels and SO(S) pixels. 


2*|GAS| 


Dice(G,S) ~ lal+is) 


Eq(1) 


If the Dice index is 1, which indicates the exactly impec- 
cable segmentation, but this finds the accuracy at pixel level 
only, so it is not accurate to calculate the segmentation at the 
gland level. So the object level Dice index is defined as in 
Eq(2),°' as 





Dice,,, (G,S) -2 S'y, * Dice(G..8.(G,))+ Yo, * Dice(G.(S,),S,) 
= 


i=l 


Eq(2) 
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n~- al/ Žo, ia -|s/ 15 
p=l q=l 


n, Total number of no empty (G)GT glands, n, Total num- 
ber of SG (S) by the segmentation process, G, describes the 
i” ground truth object, G, indicates the j" Segmented Object. 
S'(G,) denotes a GTO(G) that maximally overlaps G, and 
G(S,) describes an object that overlaps S, at maximum. Dice 
Score is the evaluation metric used to measure the similarity 
between two images. Contour based segmentation accuracy 
evaluated using object level Hausdorff distance between the 
shape of S and G.”! 





xeG YE 


H (6,5) = max, supin dæ.) supinf de} Eq(3) 


In Eq(3), Euclidean distance denoted by d(x, y) between the 
pixels x of G and y of S. If the obtained Hausdorff distance 
is small, indicates the higher similarity between the contours 


of S and G. if S Equals to G, which indicates the H(G, S) is 
zero. 


H a (GS)= =" `z *H(G,S(G)+¥ 0, *H(G.(S;),5;)| Eq(4) 


Object wise Hausdorff distance is implemented as Eq (4) to 
find the distance between object wise boundary-based seg- 
mentation accuracy. 


RESULTS AND ANALYSIS 


A polyp that causes cancer in the colon is challenging to de- 
tect because the colon consists of millions of Glands. Colo- 
noscopy reduces the risk of colorectal cancer by detecting 
and removal of polyps. By feeding these images as input to 
the deep learning architectures which use a combination of 
semantic segmentation to bring better results with a limited 
number of samples. 


Table 1: Comparison between various architectures in image segmentation. 


Architecture Dataset 





1 CNN CVC-ColonDB database 300 
2 SegNet Warwick-QU 85 
3 U-Net PhC-U373 35 
4 FCN PASCAL VOC 2011 736 


Number of images 


Total no.of Metrics Accuracy 

6 74.80% (Sensitivity) 

2 0.8636 
(Dice Score) 

3 92% (Intersection over 
union) 

4 62.7 
(Mean I.U.) 


The above table shows the different architecture and its results in terms of accuracy delivered to their evaluation metrics. The 
U-Net architecture has more accuracy of 92% of evaluation metric Intersection over the union on the dataset PhC-U373.” 


Table 2: Comparison between various architectures in object detection 
Mean Average Precision(mAP) % 


Method Backbone Input Size 


R-CNN AlexNet 227 227 <0.1 
SPPnet ZF-5 ~1000*600 <1 
Fast R-CNN VGG-16 ~1000*600 0.5 
Faster R-CNN VGG-16(ResNet-101)  ~1000*600 7 
YOLO GoogleNet 448*448 45 
YOLOv2 Darkent-19 544*544 67 
YOLOv3 Darkent-53 320*320 45 


Frames Per 
Second (FPS) 





Visual Object Visual Object Common Objects in 
Classes (VOC) Classes (VOC) Context 
2007 2012 (COCO) 
58.5 53:3 - 
59.2 - - 
70 68.4 19.7 
78.8 70.4 21.9 
63.4 57-9 : 
76.8 yew! 21.6 
= - 28.2 
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The above table describes the results generated by various 
architectures by considering the measures mAP, FCS, and 
trained and tested on various Deep learning architectures. 


CONCLUSION 


In the current article, an attempt had been made to present 
various research findings which were made by several au- 
thors and researchers to identify the Colorectal Cancer. From 
the previous works, it is understood that it 1s always better 
to identify the disease in an earlier stage to get maximum 
chances of recovery from cancer. After a detailed study on 
these traditional methods for identifying the Colorectal Can- 
cer, the accuracy of identification and the time to identify the 
disease is more. From the previous works, it is also observed 
that by using the deep learning mechanisms, the results are 
little encouraging. The results obtained by traditional fea- 
ture-based analysis procedures had already discussed in the 
current article. From the results obtained earlier, we under- 
stood that the utilization of deep learning techniques with the 
combination of semantic segmentation method will be the 
best choice for getting good results in terms of identifying 
the disease. We also try to plan for implementing the hybrid 
deep learning models for better identification of disease in 
the earlier stages as our future work. 
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